Pre-trained CNNs as Feature-Extraction Modules for Image Captioning

نویسندگان

چکیده

In this work, we present a thorough experimental study about feature extraction using Convolutional NeuralNetworks (CNNs) for the task of image captioning in context deep learning. We perform set 72experiments on 12 classification CNNs pre-trained ImageNet [29] dataset. The features areextracted from last layer after removing fully connected and fed into model. usea unified model with fixed vocabulary size across all experiments to effect changingthe CNN extractor quality. scores are calculated standard metrics inimage captioning. find strong relationship between structure datasetand prove that VGG models give least quality among testedCNNs. end, recommend each evaluation metricswe want optimise, show connection our results previous works. To knowledge, thiswork is most comprehensive comparison extractors

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Fingerprint Feature Extraction Using CNNs

Feature Extraction is an important step in fingerprint-based recognition systems. In this paper, a CNN Fingerprint Feature Extraction Algorithm is presented. It is applied to thinned fingerprints which have been previously obtained from real gray-scale, noisy fingerprints in the Image-Preprocessing stage, also by using CNNs. Examples are given to demonstrate the functionality of the proposed al...

متن کامل

Hand Veins Feature Extraction Using Dt-cnns

As the identification process is based on the unique patterns of the users, biometrics technologies are expected to provide highly secure authentication systems. The existing systems using fingerprints or retina patterns are, however, very vulnerable. One’s fingerprints are accessible as soon as the person touches a surface, while a high resolution camera easily captures the retina pattern. Thu...

متن کامل

Feature Extraction for Image Mining

Due to the digitization of data and advances in technology, it has become extremely easy to obtain and store large quantities of data, particularly Multimedia data. Fields ranging from Commercial to Military need to analyze these data in an efficient and fast manner. Presently, tools for mining images are few and require human intervention. Feature selection and extraction is the pre-processing...

متن کامل

Image Feature Extraction Acceleration

Image feature extraction is instrumental for most of the best-performing algorithms in computer vision. However, it is also expensive in terms of computational and memory resources for embedded systems due to the need of dealing with individual pixels at the earliest processing levels. In this regard, conventional system architectures do not take advantage of potential exploitation of paralleli...

متن کامل

Understanding trained CNNs by indexing neuron selectivity

The impressive performance and plasticity of convolutional neural networks to solve different vision problems are shadowed by their black-box nature and its consequent lack of full understanding. To reduce this gap we propose to describe the activity of individual neurons by quantifying their inherent selectivity to specific properties. Our approach is based on the definition of feature selecti...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Electronic Letters on Computer Vision and Image Analysis

سال: 2022

ISSN: ['1577-5097']

DOI: https://doi.org/10.5565/rev/elcvia.1436